The concept of software quality is very complex and has many facets.Reflecting all these facets and at the same time measuring everything relatedto these facets results in comprehensive but large quality models and extensivemeasurements. In contrast, there are also many smaller, focused quality modelsclaiming to evaluate quality with few measures. We investigate if and to what extent it is possible to build a focusedquality model with similar evaluation results as a comprehensive quality modelbut with far less measures needed to be collected and, hence, reduced effort.We make quality evaluations with the comprehensive Quamoco base quality modeland build focused quality models based on the same set of measures and datafrom over 2,000 open source systems. We analyse the ability of the focusedmodel to predict the results of the Quamoco model by comparing them with arandom predictor as a baseline. We calculate the standardised accuracy measureSA and effect sizes. We found that for the Quamoco model and its 378 automatically collectedmeasures, we can build a focused model with only 10 measures but an accuracy of61% and a medium to high effect size. We conclude that we can build focusedquality models to get an impression of a system's quality similar tocomprehensive models. However, when including manually collected measures, theaccuracy of the models stayed below 50%. Hence, manual measures seem to have ahigh impact and should therefore not be ignored in a focused model.
展开▼